Control of synchronization patterns in neural-like Boolean networks 
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We study experimentally the synchronization patterns in time-delayed directed Boolean networks 
of excitable systems. We observe a transition in the network dynamics when the refractory time 
of the individual systems is adjusted. When the refractory time is on the same order-of-magnitude 
as the mean link time delays or the heterogeneities of the link time delays, cluster synchronization 
patterns change, or are suppressed entirely, respectively. We also show that these transitions occur 
when we only change the properties of a small number of nodes identified by their larger in-degree, 
hence the synchronization patterns can be controlled locally by these nodes. Our findings have 
implications for synchronization in biological neural networks. 
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Introduction One striking dynamical phenomenon 
arising in complex networks is the existence of zero-time- 
lag synchronized clusters in the presence of link time de- 
lays [IH1]. I n neural networks, time delays result from 
propagation of neuronal pulses along the axons introduc- 
ing several tens of milliseconds of latency, which is signif- 
icantly larger than the duration of the action potential 
(< 1 ms) [5] . Yet, even between distant parts of the brain, 
zero-lag synchronized neural activity has been observed 
and is known to play a key role in cognitive perception 
and neurological diseases [§H2]- 

Studies on neurological networks such as in C. elegans 
found recurring topological structures of nodes assem- 
bled in loops with directed connections [10]. This type 
of network displays stable synchronization patterns with 
properties that can be inferred from the network topol- 
ogy alone. Specifically, cluster synchronization originates 
from the distribution of one initial stimulus (a pulse) in 
the network via the time-delayed links. At nodes that 
have multiple inputs, signals are combined and the prop- 
agation times from their output to their input via the dif- 
ferent loops are given by the loop sizes and, in addition, 
are affected by heterogeneity in the link time delays. If 
the heterogeneity is negligible, the dynamics relaxes to a 
stable synchronization pattern of zero-lag synchronized 
clusters, where the number of clusters is given by the 
greatest common divisor (GCD) of the number of nodes 
in each network loop [TTHH]- 

This prediction, however, relies on a separation of time 
scales, such that link time delays are larger than the char- 
acteristic time scale of the node dynamics. In addition, 
local variations of the coupling strength and noise can af- 
fect the synchronization patterns of the network, so that 
the non-local criterion of the GCD can fail to describe the 
synchronization state [TS]. In general, stability of group 
and cluster synchronization in multipartite networks, i.e., 
networks where each cluster is coupled unidirectionally to 
only one other cluster, can be predicted using the master 
stability approach 0]. In the special case that a net- 



work of identical nodes consists of directed loops only, 
the GCD theory can be applied to calculate the largest 
possible number of clusters. 

In this Letter, we study synchronization patterns in an 
experimental time-delayed network of excitable nodes for 
different regimes of the refractory times. First, we find 
a loss of synchronization when the refractory times are 
comparable to the heterogeneity of the link time delays. 
Second, we find a modification in the cluster synchroniza- 
tion patterns when the refractory times are larger than 
the link time delays. These effects can be controlled by 
adjusting the refractory times of only a few important 
nodes in the network that have the largest in-degree — a 
quantity that describes the number of input connections. 
Our findings that the refractory time affects the synchro- 
nization patterns in neural-like networks has implications 
for cognitive perception and neurological diseases, as re- 
fractory times of neurons depend on gender and blood 
concentration of chemicals like drugs and hormones |16) . 

Setup We build Boolean networks with electronic 
logic gates using a field-programmable gate array 
(FPGA) because it offers a large number (^100,000) of 
logic elements with reassignable logic functions and flexi- 
ble interconnections. Our circuits operate autonomously 
so that their dynamics are governed by the logic gate 
propagation delays and connection time delays, and not 
by a global clock. The continuous temporal evolution 
can be described mathematically by differential equa- 
tions jTTHSD]. Theoretically and experimentally, these 
autonomous Boolean networks have been found to dis- 
play a large variety of dynamical behaviors, such as 
chaos, periodic oscillations, and excitability [2"TH25] . 

Here, we realize excitable nodes with a circuit design of 
autonomous logic gates introduced in Ref. [23] and shown 
schematically in Fig. [T^,. Similar to biological neurons 
|24j . the electronic circuit responds to above-threshold 
input signals with large output signals (pulses) and leaves 
its stable fixed point for a finite time 25 . It is governed 
by two characteristic time scales given by its output pulse 



FIG. 1. (Color online) (a) Scheme of an excitable node and its 
implementation with autonomous logic gates using two pulse 
generators (boxes) . An OR gate combines multiple inputs. A 
total number of 2(n rc f + n pu i sc ) + 3 logic elements are required 
to implement an excitable node with one input, (b) The net- 
work topology, where directed time-delayed connections are 
indicated by arrows, nodes are indicated by circles and la- 
beled to identify them in the following figures, and the node 
that receives the initial pulse is also indicated. 

width Tpuisc and a quiescent time period after generat- 
ing a pulse, which is the refractory time T re f (mnemonic 
refractory) . 

The two time scales T pu isc = "-pulse ^buf and T ro f = 
"ref T buf can be varied by changing the numbers n pu i se 
and n re f of autonomous delaying elements (buffers, im- 
plemented with two consecutive inverter gates), where 
Tbuf = (560 ± 20) ps is the propagation time through 
one delaying element. The quantity Tb u f fluctuates in 
time by ±1% due to timing jitter. In addition, t^ u £ has 
slightly different values for different logic elements due 
to process variation in the fabrication of the integrated 
circuits, quantified by a heterogeneity of ±3.5%. Here, 
we implement networks of several excitable nodes using 
many logic gates on the chip. We state average values for 
the properties of the nodes, which are therefore affected 
by the latter error estimation. 

We build networks by connecting excitable nodes with 
directed time-delayed links, where link time delays r = 
n T Tb u f are realized with n T cascaded delaying elements. 
When nodes have multiple input connections, these sig- 
nals are combined with electronic equivalents of neuro- 
logical synapses [2B]. We implement electronic synapses 
with OR gates so that any of the inputs can excite the 
node. In this fashion, we can create large networks and 
study the dynamics. 

Synchronization patterns We study cluster synchro- 
nization in a network with a topology shown in Fig. [TJd 
with N = 32 excitable nodes assembled in four directed 
loops of 8, fO, f2, and 16 elements. First, we consider 



FIG. 2. (Color online) Network dynamics of a 2-cluster 
state with node parameter n pu i sc = 4 [T pu i sc = (2.2 ± 0.1) ns], 
n rc f = 10 [Tref = (5.6 ± 0.2) ns] and link delay times n T = 30 
[r = (16.7 ± 0.6) ns] after initial stimulation of one node with 
one pulse of width w = (1.6±0.1) ns. The inset is a replica of 
the topology of the network, where nodes are colored by clus- 
ter, (a) The output waveform of four nodes in the network. 
Input-output gates are used for the readout with the oscil- 
loscope (8 GHz analog bandwidth, 40GSa/s sampling rate), 
(b) Raster diagram of the network, where each point repre- 
sents the temporal occurrence of a spike with a 2 ns resolution. 
The network is realized using an Altera Cyclone IV FPGA 
(EP4CE115F29C7N). 

the case of a separation of time scales with node refrac- 
tory times of T rc f = (5.6 ± 0.2) ns. The ith loop has a 
propagation time T, associated with it, given by 

Tj = Li(r + S) + Ai, (1) 

where Li is the number of nodes in the loop, r = (16.7 ± 
0.6) ns is the delay of a single link, 5 is the processing 
delay of one node, and Aj is the heterogeneity in loop i. 
We measure the maximum heterogeneity in our network 
to be A = maxijdAj - Aj|) = (2.8 ± 0.1) ns. 

With separated time scales satisfying r > T lc f > A, 
the experimental network displays two zero-lag synchro- 
nized clusters as shown in Fig. [2^. The waveforms of 
four nodes, two out of each cluster, show coherent spik- 
ing with period T c i ustor ~ GCD • r = 2t. This behavior 
is also predicted by the GCD theory from the number of 
elements in each loop, as GCD(8, 10, 12, 16) = 2 [T2]. 

The spiking dynamics of the entire network is shown 
in the raster diagram in Fig. [2Jd, where each dot repre- 
sents a spiking event, subject to a discretization error of 
±lns. The first (last) 16 elements, as also shown in the 
inset, are in near zero-lag synchronization and belong to 
a cluster. The variation (±4ns) in spike generation time 
between nodes is due to differences in the link time de- 
lays and measurement error that originates from signal 
propagation delays on the FPGA. 

To our knowledge, this network is the largest experi- 
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FIG. 3. Same as Fig. [5J except with n rc f = 5 (T rc f = 
(2.8 ± 0.1) ns), showing a desynchronized state (synchroniza- 
tion breakdown) of the network dynamics. 



FIG. 4. (Color online) Same as Fig. [5J except with n ro f = 70 
(T rc f = (39 ±2) ns), showing four clusters in zero-lag synchro- 
nization (4-cluster state). 



mentally implemented complex network showing cluster 
synchronization that operates without computer assis- 
tance, which is commonly used to manage the network 
coupling in experiments ,141, 126, 27J. This illustrates that 
our setup is well-suited to build large networks compared 
to other experimental approaches [13] . 

We can access network dynamics that are not predicted 
by topological considerations with the GCD by changing 
the separation of time scales (r > T ro f > A) in our sys- 
tem. Time scales are adjusted by changing the refractory 
time of the excitable nodes. First, we study short refrac- 
tory times T re f on the order of the heterogeneities A of 
the link time delays and, second, long refractory times 
Trof on the order of the link time delays r. 

When we decrease the refractory time to a value of 
T re f = (2.8 ± 0.1) ns, the network dynamics change. In- 
stead of cluster synchronization with oscillations on the 
order of r, the network displays fast, incoherent spiking 
dynamics with interspike intervals on the order of T re f, 
as shown in the waveform and raster diagram of Fig. [3] 
For easy comparison with the previous figure, the time 
axis is kept the same. The new dynamical state gener- 
ates excitations constantly, leading to pulsing dynamics 
with high frequencies close to the maximum frequency 
allowed by the excitable nodes, given by 1/T re f. 

The breakdown is caused by heterogeneity in the 
loop propagation times at the high-in-degree nodes. 
With Eq. (JlJ, a maximum time difference A = 
max, j(|Aj — Aj\) = (2.8 ± 0.1) ns exists in the propa- 
gation times Ti of the network loops and leads to a mis- 
match of the arrival times of pulses. When A < T re f, 
the refractory time can compensate for the mismatch, by 
blocking pulses that arrive a time A after the first pulse 
during every period of the clusters T cluste r- In this case, 
the spiking dynamics stays coherent. Otherwise, when 
A > T re f, the pulse that arrives a time difference A after 



the first pulse will trigger additional pulse trains, leading 
to incoherent high-frequency spiking. 

Besides the breakdown for small T ro f, the cluster syn- 
chronization patterns are also affected for large T rc f. 
When the refractory time is increased to T xe f = (39 ± 
2) ns « 2.3r, the network displays four synchronized clus- 
ters (4-cluster state) instead of the 2-cluster state that is 
inferred from the topology and observed in Fig. [2] as 
shown in the waveforms and raster diagram in Fig. [4j 

To understand this behavior, we consider the maxi- 
mum output frequency of the excitable node, given by 
l/Tief. When the predicted oscillation frequency, given 
by 1/T c i us tcr ~ 1/(GCD • t), is above the maximum fre- 
quency 1/Tef, the network cannot show the predicted 
cluster state and the dependency on T re f comes into ef- 
fect. Loops that generate pulses with periods T < T rc f , as 
predicted from the topology, are suppressed at nodes with 
high in-degree, because the pulses fall into the refractory 
phase of pulses from other loops. Thus, the GCD has to 
be recalculated by neglecting some loops, using only the 
loops that lead to a GCD larger than T re f/r. Because 
this pulse-blocking mechanism is based on short oscilla- 
tion periods, the loops that are effective for the cluster 
dynamics and used for the calculation are those that lead 
to the smallest value of the GCD that is greater than 
T tc {/t, i.e., that lead to the shortest period greater than 
T rc f. Therefore, with the size of loops L,, the number of 
clusters is given by 

min [GCD({LJ)] : GCD({L, ; }) > T ref /r. (2) 

{Li\£ Network 

This extended criterion describes successfully the sta- 
ble synchronization patterns observed in Fig. [4] Because 
GCD(8, 10, 12, 16) = 2 < T rc f/r w 2.3, a loop needs to be 
exempt from the calculation, leading to the next larger 
GCD value of GCD(8, 12, 16) = 4 > T ref /r « 2.3. There- 
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fore, the modified GCD theory predicts the experimen- 
tally observed 4-cluster state. 

The constraint given by T re f depends on the network 
topology. For example, a network with predicted zero-lag 
synchronization (1-cluster state) transitions to a different 
cluster state already when T re f/r > 1. When T re f is 
further increased, more and more loops lose their effect 
until the refractory time is longer than the propagation 
delay through the largest loop; then, spiking dynamics is 
no longer self-sustained and the network relaxes to the 
quiescent state. Surprisingly, in our topology, it is not 
the shortest loop with eight nodes but the loop with ten 
nodes that becomes ineffective first. 

Degree- correlation A global adjustment of the refrac- 
tory time T rc f of all nodes influences the network dy- 
namics significantly. However, we can even achieve local 
control of the global network dynamics by adjusting the 
properties of only a small number of nodes. 

The influence of the refractory time on the network 
dynamics is most prominent at the nodes with high in- 
degree. This motivates us to only adjust the refractory 
times of the nodes with in-degree greater than one, which 
represents a simple degree-correlation [25] , 

First, we investigate the network dynamics for short 
refractory times. We set the refractory times of nodes 
to Tj-ef = (2.8 ± 0.1) ns, a value for which the breakdown 
of cluster synchronization is observed. When we now 
increase the refractory times of the two nodes with an 
in-degree greater than one (node 13 and 30 in Fig. [T]d) 
to T rc f = (5.6 ± 0.2) ns, the stable synchronization pat- 
terns reappear as a solution. An initial pulse sent to this 
network in the quiescent state leads to a 2-cluster syn- 
chronization pattern similar to that observed in Fig. [2j 

Second, we investigate network dynamics for large re- 
fractory times. We set the refractory times of all nodes 
to T le { — (5.6 ± 0.2) ns, a value for which a 2-cluster syn- 
chronization state is observed. When we now increase 
the time scales of the two nodes with an in-degree greater 
than one to T re f = (39 ± 2) ns, the stable synchronization 
pattern changes to a 4-cluster state, which we have ob- 
served in Fig. [4j when increasing the time scales of all 
nodes. 

Both cases allow for the control of the synchronization 
patterns locally by a small fraction of the network nodes 
by adjusting the refractory time of only 2 out of 32 nodes. 

Conclusion Cluster synchronization patterns change 
when the refractory time of the nodes is larger than the 
link time delays or smaller than the heterogeneity of the 
link time delays. For large refractory times, cluster syn- 
chronization patterns are modified, and, for short refrac- 
tory times, cluster synchronization breaks down to an 
incoherent state. In both cases, we identify the mech- 
anism leading to the transition and, in the first case, 
we put forth a modified GCD criterion that includes the 
constraints imposed by the refractory time. The syn- 
chronization patterns can be controlled by the refractory 



time of a small fraction of nodes, identified by their in- 
degree. In biological neural networks, refractory times 
depend on hormone levels and are affected by drugs, so 
that the connection between the refractory time and the 
neural activity patterns shown here may play a role in 
cognitive processes and neurological diseases. 
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